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(54) Distributed internet protocol-based real-time multimedia streaming architecture 



(57) Multiple media push engines communicate 
with the multimedia client through a mufti casting net- 
work that may incorporate multiple delivery paths. The 
streaming data representing media selections for deliv- 
ery are distributed across multiple media push engines 
using a non-hierarchial coding technique in which the 
data are represented as a set of substream compo- 
nents, capable of being reconstituted from fewer than all 
of the components of the original data stream. The 
higher the number of components used in reconstitu- 
tion, the higher the quality of service is provided by the 



reconstituted stream. Admission control to the group 
multicast session is administered in a distributed fash- 
ion, where an admission control unit opens the multicast 
stream, with all subsequent admission control decisions 
being made by the media push engines themselves. 
Substream component data are 6ent using Real-Time 
transport protocol while session management and the 
distributed admission control process are administered 
under the Real-Time Control Protocol. 
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Description 

Background and Summary of the Invention 

[0001 ] The present invention relates generally to net- s 
worked multimedia systems. More particularly, the 
invention relates to a media delivery system for deliver- 
ing media selections to one or more media clients over 
a multicasting network. 

[0002] With the explosive growth of the Internet, there 
is a growing interest In using the Internet and other 
Internet protocol-based networks to deliver multimedia 
selections, such as video and audio material. Interactive 
television, movies on demand, and other multimedia 
push technologies are among the more promising appli- 
cations. 

[0003] The Internet is a connectionless network offer- 
ing best effort delivery service. Packets of data are 
routed as datagrams that carry the address of the 
intended recipient. A specific connection between the 
sender and the recipient is not required, because all 
host nodes on the network include the inherent capabil- 
ity to route datagrams from node to node until delivery is 
effected. This datagram packet delivery scheme is con- 
structed as a best effort delivery system in which the 
delivery of datagram packets is not guaranteed. Data- 
gram packets may be sent via different routes in the 
effort to increase the likelihood of delivery. Thus, if one 
node on the network is experiencing congestion, subse- 
quent datagrams may be alternately routed to avoid the 
congested node. This means that data datagram pack- 
ets do not inherently have a guaranteed arrival time. 
Even packets corresponding to a single message may 
be received out of order. This tact significantly affects 
how certain multimedia data are delivered. 
[0004] In many cases, multimedia data require real- 
time delivery. In the case of audio or video data, the 
data stream representing a particular media selection 
needs to be delivered in the proper time sequence, to 
allow the user to play back the audio or video selection 
"live" as it is being sent. Clearly, H the datagram packets 
are delivered out of order, due to taking different deliv- 
ery routes, then playback at the multimedia client (e.g., 
a user's interactive TV) will be jumbled. 
[0005] The Real-time Protocol (RTP) is a current de 
facto standard for delivering real-time content over the 
Internet (or other networks based on an IP protocol). 
The Real-time Protocol replaces the conventional trans- 
mission control protocol (TCP) with a framework that 
real-time applications can use directly for data trans- 
port. Currently, the RTP standard supports a first type of 
message, namely one for carrying the media content 
data or streaming data. Typically, a separate protocol, 
the Real-Time Control Protocol (RTCP) is used with 
RTP to pass control messages for session manage- 
ment, rate adaptation and the like. 
[0006] While the Real-tim Protocol can be used to 
deliver multimedia streaming data over computer net- 



works, the existing architecture has not proven robust 
enough to provide high quality preserrtati n using best 
effort network services such as those provided by the 
Internet The present irtventi n solves this problem by 
using a distributed media push architecture that is capa- 
ble of supplying streaming data redundantly from multi- 
ple sources and over multiple distribution paths. The 
media push engines have associated media storage 
units that store streaming data as non-hierarchial sets 
of substream components. The components are capa- 
ble of being reconstituted into a reconstructed stream 
from fewer than all of the components, such that the 
higher the number of components used in reconstitu- 
te the higher the quality of the reconstructed stream. 
[0007] Conventional systems use a hierarchial coding 
scheme that treats some components as more impor- 
tant than others. Thus, conventional systems typically 
need to expend considerable resources to guarantee 
that the more important components are always deliv- 
ered. In contrast, the media delivery system of the 
invention uses a non-hierarchial coding scheme, multi- 
pie description coding (MDC) that treats all components 
as equals. Thus, no special resources need to be allo- 
cated to ensure that a given set of substream compo- 
nents is delivered. Naturally, the higher number of 
components delivered, the higher the quality achieved; 
on the other hand, unlike with conventional hierarchial 
coding, toss of any given single packet does not appre- 
ciably degrade the signal quality. 
[0008] The distributed media delivery system also 
employs a distributed admission control system. The 
media client contacts a single admission control unit to 
request a given media selection, but thereafter the 
admission control decisions are handled in distributed 
fashion by the media push engines themselves. The 
admission control unit communicates the request to a 
plurality of media push engines distributed across the 
network and those push engines individually determine 
whether they can participate in the multicasting session. 
Thus, the individual media push engines each evaluate 
local traffic congestion to determine whether it is capa- 
ble of supplying the requested data stream. The admis- 
sion control unit is thus not involved in directly 
determining which media push engines should be 
admitted to a multicast group session. The admission 
control unit simply assigns the multicast group session 
address and then allows the admission process to pro- 
ceed autonomously, in a distributed fashion. 
[0009] For a more complete understanding of the 
invention, its objects and advantages, reference may be 
had to the following specification and to the accompany- 
ing drawings. 
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[0010] 

Figure 1 is a network datagram illustrating a pre- 
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